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In this Letter we describe a simple randomized benchmarking protocol for quantum information 
processors and obtain a sequence ol models for the observable fidelity decay as a function of a 
perturbative expansion of the errors. We are able to prove that the protocol provides an efficient 
and reliable estimate of an average error-rate for a set operations (gates) under a general noise model 
that allows for both time and gate-dependent errors. We determine the conditions under which this 
estimate remains valid and illustrate the protocol through numerical examples. 



The challenge of characterizing the level of coherent 
control over a quantum system is a central problem in 
contemporary experimental physics and a fundamental 
task in the design of quantum information processing 
devices. Full characterization of any quantum process 
is possible though quantum process tomography (QPT) 
[1]. This has been successfully applied to the measure- 
ment of up to three coupled qubits (two-level systems) in 
NMR [2, 3], linear optics [4], atomic ions [5] and super- 
conducting qubits [6, 7]. However, QPT sufferers from 
two shortcomings: the first is the often unrealistic as- 
sumption that the set of measurements and state prepa- 
rations admit much lower errors than the process which is 
being characterized; the second is that the number of ex- 
periments required grows exponentially with the number 
of qubits, and hence QPT becomes infeasible in practice 
for systems consisting of more then just a few qubits. 

Recently there has been significant interest in scalable 
methods for partial characterization of the noise affect- 
ing a quantum process [8-10]. In particular, randomized 
benchmarking (RB) protocols [11-13] have been conjec- 
tured to provide a means for characterizing the level of 
coherent control over a set of quantum transformations, 
or gates, in a way that overcomes the two shortcoming of 
QPT identified above. The practical feasibility of these 
procedures has lead to initial experimental implementa- 
tions of RB in atomic ions for different types of traps 
[13, 14], NMR [15], superconducting qubits [6, 16], and 
atoms in optical lattices [17]. In such protocols one sim- 
ply measures the exponential decay rate of the fidelity as 
a function of the sequence length for random sequences 
of gates. The measured decay rate is presumed to give 
an estimate of the average error probability per gate [11- 
13, 18]. However, it is easy to show (via a counter exam- 
ple with gate-dependent errors that consist of the exact 
inverse of the gate applied) that the decay rate estimated 
via RB methods can be totally unrelated to the actual 
error-rate. 

In this Letter we develop a perturbative expansion 
for the error superoperators that leads to a sequence of 
increasingly precise fitting models for the experimental 
data, requiring only that the variation in the errors over 



the RB gate set is not too strong. Our analysis is valid 
for a realistic noise model admitting time-dependent and 
gate-dependent errors and also accounts for state prepa- 
ration and measurement errors. We derive an explicit 
first-order fitting model for estimating the average error- 
rate, as well as the degree of gate-dependence in the er- 
rors associated with the RB gate set. 

A RB protocol consists of the following steps: 

Step 1. Generate a sequence of m + 1 quantum op- 
erations with the first m operations chosen uniformly at 
random from some group Q C U(d) and the final opera- 
tion (m + 1) chosen so that the net sequence (if realized 
without errors) is the identity operation. We are pri- 
marily interested in the case where Q corresponds to the 
Clifford group on n-qubits (d = 2") because each ele- 
ment of the Clifford group can be realized efficiently on a 
quantum processor, and because the required correction 
operation can be pre-computed efficiently [19]. In prac- 
tice each operation d j will have some associated error 
and the entire sequence can be modeled by the operation 

<5i m =Or= + i 1 (A i3 , j oC ij ), (1) 

where i m is the m-tuple ...,i m ) and i m +i is uniquely 
determined by i m . In the above, Aj. j is a linear superop- 
erator representing the error (e.g., a completely positive 
trace-preserving map) associated with the operation Ci j , 
and is allowed to depend independently on the time-step 
j. This is a very general noise model - the only assump- 
tion is that the correlation time of the environment is 
negligible on time-scales longer than the time of the op- 
eration Ci j . 

Step 2. For each sequence the survival probability 
Tr[£^,Si m (p,/,)] is measured. Here p^ is the initial state 
taking into account preparation errors and E$ is the 
POVM element that takes into account measurement er- 
rors. In the ideal noise-free case p$ — = [V'XV'I- 

Step 3. Average over random realizations of the se- 
quence to find the averaged sequence fidelity, 

(m,V) = Tr[E^S m (p^)], (2) 
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where 



1 l{im}| 



(3) 



is the average sequence operation. 

Step 4- Fit the results for the averaged sequence fi- 
delity [Eq. (2)] to the model 

F« (m, V) - + Bi + d(m - l)(g - p 2 )?™" 2 (4) 

derived below. The coefficients A\, B\, and C\ absorb 
the state preparation and measurement errors as well as 
an edge effect from the error on the final gate. The differ- 
ence q — p 2 is a measure of the degree of gate-dependence 
in the errors, and p determines the average error-rate r 
according to the relation 



r = 1 — p — (1— p) jd. 



(5) 



In the case of gate-independent and time-independent 
errors the results will fit the simpler model 



Fj&M) = A oP m + B 



(6) 



derived below, where Aq and Bq absorb state preparation 
and measurement errors as well as an edge effect from the 
error on the final gate. 

The average error-rate r that is determined by the 
above protocol has the following independent meaning. 
For each error j (associated with the implementation 
of the ideal operation Cj), the probability of no error 
occurring for input state <f> is just the survival probabil- 
ity s l3 j((j>) = (<f>\Ai.j(\(f))((f)\)\<t>}. The (state-dependent) 
error probability for this operation is 1 — Si.j(ip). If we 
average this error probability over all pure input states 
using the invariant (Haar) measure d<fi, this defines a 
Haar-averaged error-rate for each operation 1 — Sj . j — 
1 — J d(j) s i:j j (<ft) . Then, given any set of errors { j } as- 
sociated with a set of operations {Cj }, we invoke another 
average over this error set in the usual way, 



\{(ij,3)}\ 



E a 

»j ,3 



(7) 



which defines r, the average error-rate we want to esti- 
mate. 

The average error-rate r can be determined from the 
observed fidelity decay in an RB experiment when the 
set {d} is a unitary 2-design [18] as well as a subgroup 
of U(d). The former condition allows us to write 

... £^|C/ ° Ai, j o d (|V)(V|) |V>>, (8) 



where K is the size of the Clifford group on n- 
qubits. Direct evaluation of the average over Cliffords 



[18, 20], or equivalcntly the Haar-average [11, 21], gives 
f #(V>|A i . ij (|V>)(^|)|V>) =Pi j j + 0--Pi i j)/d, where Pijij 
is a Haar-invariant (depolarization) parameter charac- 
terizing each error operator Aj.j. The average p = 
itt- 1 to yZr; *\Pi ? is th° parameter appearing in the 
fitting models presented in Eqs. (4) and (6), which we 
now derive. 

In the idealized case of gate-independent and time- 
independent errors we have Aj j = A for each 
Repeated application of the identity operation d j o C\ 
in Eq. (1) gives 



(9) 



where we have used C im+1 o ■ ■ ■ o C it — 1 and for each j 
defined a new gate T>i . = d . o • • • o d 1 that is indepen- 
dent from the gates which where performed at time-steps 
earlier than j (Ci j _ 1 etc ). Substituting this into Eqs. (2) 
and (3) the average sequence fidelity is 



^ e )(m,^) = Tr[^AoA t o ™ rl W)] ; 



(10) 



where A twirl = ^. A h /K with A;. = v\. oAoV ir We 
are left with an m-fold composition of gate-independent 
twirls over the Clifford group which implies the twirled 
operation A tw iri is a depolarizing channel (Ad cp ) [18]. 
Hence the gate-independent sequence fidelity reduces 
to Eq. (6) with A a = Tr[E^A(p^ - t/d)] and B = 
Tv[E^A(t/d)}. 

More realistically the noise operator can be both gate 



and time-dependent A 



A, 



We can character- 



ize the behavior of F seq (m,ip) by considering a pertur- 
bative expansion of each Aj.j about the mean error 



A = 



EiJS'^'Ai^. Defining 5A ijtj = A ijtj 



\{(ij,3)}\ 



A 



Vi,-, our perturbative approach will be valid provided 



<5A,: 



is small for each ij in a sense to be made precise 



later. Note that each SA ijt j is a Hermitian-preserving, 
trace-annihilating linear superoperator. 

Using the same change of variables described above, ie, 



V im = OT=l C ii > we find that 5 i m = + + S i 
where S-^ corresponds to the gate independent case, 
is the first order correction and so on. The first order 
correction consists of three terms: (la) the small gate- 
dependent perturbation acts on the first gate, (lb) it acts 
somewhere in the middle (there are m— \ of these terms), 
and (lc) it acts on the final gate. Explicitly, 

S^ a) =A o A lm o ... o A l2 o (pi o SA iul o V h ) 



:(!) 



,(2) 



5. (lh) =A o A, o ... o (v] o SAi ,oV t 



O ... O A,; 



SI 



(lc) 



-5Aj 



O A,- O ... O A,-, . 



(11) 



Averaging each of these terms over i m gives 

5i la )=AoAr p - 1 o(Q 1 -A dcp ), (12) 
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where we define for each j , Qj = J7 Dj, ^ o Aj . j o Dj . /if. 
Note the correlations between the noise and the gate op- 
erations prevent this from resulting in a depolarized chan- 
nel. 

For the to — 1 first-order terms with j e {2,..., to} 



(case b) averaging gives si lb) - ^.,=2 11 " J Me P 

((Qj ° A )dc P - A d? P ) ° A dop 2 where the subscript "dep" 
represents the depolarization of the operator within 
brackets. For these terms the main trick is to realize 
that we can re-expand V ij — d j o T> ij _ 1 in order to de- 
polarize Cj o SA i:j j o d j o A under the twirling operation 
'■ Using the fact that depolarizing 
channels commute, Sm^ simplifies to 

m 

i° 2 ^ 



^ = E A ° («2i ° A )dep - A d?p) ° A£" 



(13) 



J=2 



To find the expression for Sm^ we have to use the fact 
that the Cliffords are a group. If i\, ...,i m -i are fixed, 
averaging over the i m index runs through every Clifford 
element with equal frequency in the V im random vari- 
, llTO +i is just the error associated with 



l+ i,m+l ° 

.,i m -i indices and 



D. 



A o Vj 



IS 



(14) 



able. Since A 
the gate V\ m , J2i m SA 
independent of the i\, 

5i lc ) = (^„ l+1 -AoA dop )oA°™- 1 

where U m+ i = J2i m A i' m ,m+i ° (cj m o A o djj /K. In 
the above sum Aj' , TO +i denotes the error that arises 
when the Clifford operation C\ is applied at final time- 
step to + 1. 

Combining these three terms it can be shown that the 
average sequence fidelity is given by Eq. (4) with 

1)1 



A x = Tr 



E^A 



Qi(pv) „ , (p 

- Pi> H 



+Tr 



B 1 = Tr 



Ci =Tr 



E^lZ m +i 



E^A 



Pip 



(15) 
(16) 
(17) 



where q — X^=2 1j I ( m ~ -0 an< ^ 1o 1& depolarizing pa- 
rameter defined by {Qj o A)d cp (p) = qjP + (1 — qj)l/d. 
Here we see that the edge effects are represented by the 
three coefficients Ai, B\, and C\ and there is a slight 
to dependence in the A\, and B\ coefficients due to the 
last gate. This is unavoidable but as long as to is large 
enough the exponential dependence will be distinguished 
from this dependence. Furthermore, if the errors don't 
change as a function of time and only depend on the 
gate implemented (not time) then this dependence also 
disappears. 



We now give conditions for when it is justified in stop- 
ping the expansion at first order. We use the "1 — > 1" 
norm on linear superoperators maximized over Hermi- 
tian inputs, denoted || • HfL^, to make this precise [22]. 
Applying the triangle inequality multiple times we find 
that for each order k 



S (k) 



H \ - 



(18) 



jk>--->jl 



where jj := ||A^ — A^^^/K is a measure of the 
variation in noise. In the case where the noise is time- 
independent Eq. (18) becomes WS^W^ < ( m ^ X )7 fe . 
Note that this norm bounds the fidelity and thus we have 

H 



|_p(fe+i)__p(fe)| < 



? (fe) 



< 



( m + 1 ) 7 fc . Hence the jfe + 1 



order correction to the fidelity formula can be neglected 
provided that 

(to + 1 - fc)7/(l + k) < 1. 

Therefore we can ignore second order terms when the 
variation in error strengths satisfies 7 <C 2 /to. Note that 
in practice one also needs to 3> 1 in order to generate 
enough data points for a reasonable estimate of p in the 
fitting model. 

As an example of the procedure, we first consider 
the case of benchmarking a single qubit under time- 
independent unitary errors with no state-preparation or 
measurement errors. For each Cj, the unitary error was 
constructed by finding the Hamiltonian that generates 
the Clifford operation via Cj(p) = cxp{—iHj)pcxp(iHj). 
For each Hj, the unitary e~xp{—iHj) was diagonalized and 
to simulate the error one of the eigenvalues was multiplied 
by e tS and the other by e~ lS . Physically this corresponds 
to over/under rotations around Hj. 

Two cases for 5 were analyzed: 5 = 0.1 (case A) and 
8 chosen uniformly at random in the range [0.075, 1.125] 
(case B). Numerical values for F seq {m, -0) are shown in 
Fig. 1 as blue points. Note that we have subtracted the 
DC offset in the model so that pure exponentials appear 
as straight lines on the semilog plot. In the present case 
B\ = Bo = 1/2 since the noise is unital and there are 
no state preparation or measurement errors. For both 
cases the first order result fits the data extremely well 
(green line) while the zero'th order (red dashed) only 
approximates the sequence fidelity when the variation 
in S is small (case A). Furthermore, in case B the non- 
exponential behaviour of the average sequence fidelity is 
clearly visible. This is also apparent in Table I which 
shows that the gate-dependence fit parameter q — p 2 is 
much larger for case B than case A. 

We also considered two other error models of practi- 
cal relevance: unitary error with depolarizing noise and 
unitary error with amplitude damping. The depolariz- 
ing and damping parameters were chosen randomly in 
0.9875 ± 0.01 with the unitary error chosen in the same 
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FIG. 1. (color online) Average sequence fidelity as a function 
of sequence length for a error model with unitary noise. See 
text for details. 





Unitary A Unitary B 


Unitary and Dep. 


Unitary and T\ 


p 




0.980 


0.943 


0.982 


0.988 


r 




1.05c-2 


2.85e-2 


8.75o-3 


5.85o-3 


<? - 


v 1 


-2.73c-4 


-6.83o-3 


-2.77c-8 


-2.80e-8 



TABLE I. Numerical results for the parameter p, error rate 
r, and our gate dependence measure q — p 2 for the four cases 
of noise models considered. See text for details. 



way as case A. The results are summarized in Table I - in 
both these cases the simulations are well approximated 
by the zero'th order solution. These results further illus- 
trate that the zero'th-order randomized benchmarking 
model gives a robust estimate of the error-rate for a va- 
riety of error models provided that the variation in the 
noise is small enough. 

The size of the Clifford group scales as 2°(™ 2 ) [23] and 

so the number of sequences of length m scales as 2 m °(™ ) . 
Hence full averaging over the Clifford group is not effi- 
cient. Fortunately, random sampling provides an efficient 
means of estimating the full average. Intuitively this can 
be understood by realizing that the end goal is simply to 
estimate a single probability for each m, and the number 
of repetitions required for this should be no more than 
what is required to estimate the bias of a coin. More 
precisely, Hoeffding's inequality specifies that, with con- 
fidence S and accuracy e, the number of trials k needed for 
approximating the average sequence fidelity is no larger 
then k — ln(2/<5)/2e 2 , which is independent of m and 
n. This result assumes one can sample uniformly from 
the Clifford group. For experiments on just a few qubits, 
one can sample uniformly from the Clifford group by con- 
structing an exhaustive list of distinct Clifford elements 
and then sampling uniformly from that list. 

For arbitrary n, the efficiency of our protocol relies on 
the ability to sample uniformly either from the full Clif- 
ford group or some approximate 2-design that is also a 
group, in an efficient way. One method for producing ap- 
proximately uniformly random elements of the full Clif- 



ford group (and hence creating an approximate 2-design) , 
proposed in Ref . [20] , consists of randomly applying gates 
from a specific generating set G for the Clifford group. In 
this approach the number of gates b that are required is 
shown to scale polynomially in n when the generating set 
consists of C-NOT's on all pairs of qubits, and all single 
qubit Hadamards and phase gates (with inverses). 

Another approach is to take the generating set to be 
the full two-qubit Clifford group on each pair of qubits, 
in which case the number of gates needed to generate 
an approximate 2-design on n qubits is a polynomial of 
substantially smaller degree [24] . In any of these random 
circuit approaches the RB protocol yields an error-rate r 
that is associated with the cumulative error operator for 
a sequential block of one and two-qubit generating gates 
of size b. The total number of gates in the RB protocol is 
mb, where m is the number of operations sampled from 
the corresponding approximate 2-design. 

In conclusion we have described a protocol for estima- 
tion of error-rates in noisy quantum information proces- 
sors that consists of applying random sequences of Clif- 
ford operations and measuring the average sequence fi- 
delity. We prove that, provided the variation in the errors 
is not too strong, this protocol gives an efficient and reli- 
able estimate of the average error-rate for a realistic noise 
model which admits both gate and time-dependent er- 
rors. We derive zero'th-order and first-order fitting mod- 
els for the experimental data and numerically illustrate 
the relevance of both models. 
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